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ABSTRACT 



As packet switched networks become more widely used, 
there will be a need to characterize network performance 
with an index that defines how well the network can meet the 
user's needs. This thesis explains present and future meas- 
ures of network performance, some of which are user- 
oriented, and how they can be useful. Dividing users into 
groups based on user needs, a model of a composite perform- 
ance index is developed. The usefulness of this index, if 
provided on a real-time basis, is then explored and 
substantiated. 
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I. INTRODUCTION 



Presently our world is evolving in a direction resulting 
in the generation of tremendous amounts of information. This 
information is often of little value when it is restricted 
to individuals, that is to say, there are usually benefits 
to be derived from sharing information. Exchanging ideas, 
avoiding duplication of research effort, and the ability to 
utilize the facilities of others are only a few examples of 
the benefits that information sharing can provide. 

This information exchange is done by using networks; 
social networks such as conferences and meetings, written 
media such as books and papers, and now with new technology 
much of this information exchange is being done using tele- 
communication networks. A particular type of network 
receiving increased notoriety due to its speed and effi- 
ciency is the packet switched network. 

The rapid growth of technology and hardware has led to 
the development of networks capable of tremendous amounts of 
information exchange. These networks are becoming more 
widely used by the public sector. The network capabilities 
have outpaced our ability to manage and control these 
networks in that we are constantly finding ways of 
extracting more capability out of existing networks in terms 
of what it can provide to the user. With managers becoming 
overwhelmed at what technology can accomplish, the user is 
doubly overwhelmed. 

In utilizing the service provided by a network, the user 
developes an impression of how well the network is meeting 
his needs - he is in essense developing a subjectively 
determined network performance level at the particular 
instance in time. The actual performance level is changing 
constantly, usually at a rate faster than the user is 
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capable of subjectively determining. An objective measure of 
network performance based upon actual network status, if 
available to the user, could be very valuable. It could 
likely enhance the user’s benefit from the network in that 
he would know from the start of his network session how well 
the network is performing. This could result in more optimal 
use of his time, money, and communication resources, not to 
mention reducing the user's aggravation in using the 
network. It could also be of benefit to the network itself 
in that it may more evenly spread the demand on an already 
overloaded network. 

Many things affect how a network performs. The speed and 
accuracy of the hardware, the efficiency of the software, as 
well as how these various resources are linked together 
determine the maximum performance level of the network. The 
users demands and how the network managers and operators 
control the network have a significant impact on how the 
network is meeting the needs of the user at particular time. 
This thesis will investigate how a user-oriented performance 
measure could benefit both network users and managers. 

A fundamental question is" What network parameters do we 
measure to determine its performance?" Numerous technical 
details of the inner workings of the network are measured 
and are extremely useful to the manager in performing his 
task of planning, resource allocation, configuration 
control, and status monitoring all of which hopefully result 
in optimization of network performance. Significant stan- 
dardization of what to measure and how to measure it does 
not exist and that which is measured is of little value to 
the user in that it is either too technical, too multi- 
faceted, or not timely. 

Standardized performance parameters are being investi- 
gated by several organizations such as the American National 
Standards Institute (ANSI), the National Telecommunications 
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and Information Administration (NTIA), and the International 
Telephone and Telegraph Consultive Committee (CCITT). Some 
strides have been taken towards developing user-oriented 
performance parameters but only to the extent that they 
recognize that network performance should be optimized with 
the user in mind. This applies to network planning, design, 
and management control. This is a step in the right direc- 
tion but falls short of developing a measure of network 
performance that is of value to the user at the time he 
actually wishes to use the network. 

This thesis, written with the network user in mind, will 
first explain what packet switched networks are, how they 
work, and why they are becoming more widely used in the next 
chapter. Chapter three explains how packet switched network 
performance is presently measured and how they are used. A 
method of determining a user oriented performance figure-of- 
merit for a packet switched network is explained in chapter 
four with three classes of users in mind; large volume data 
users, interactive processing users, and voice users. 
Chapter five outlines future developments in network 
performance monitoring, conclusions, and areas for further 
research. 
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II. PACKET SWITCHED NETWORKS 



A. INTRODUCTION 

Communication networks can be divided into several 
different types but probably the most common network type 
classification is [ Ref. 1] : 

1. Circuit-switched 

2. Message- switched 

3. Packet-switched 

1. Circuit Switching 

In circuit switching, a "call" is set up between 
users and message transmission takes place in a conversa- 
tional mode. To set up the call, a path of connecting trans- 
mission lines must be established between source and 
destination. When a user wishes to communicate with someone, 
a signal is transmitted through the network, seizing avail- 
able channels in an attempt to reach the destination. If no 
path is available, a signal is sent back to the caller indi- 
cating he must wait until the necessary channels are free. 
When a path has been established, message transmission takes 
place over all of the channels in the path in both direc- 
tions, simultaneously. The path remains allocated to the 
users until the caller releases the path or until the call 
is preempted by a user of higher priority. 

For many years, circuit switching was the most 
effective means of communicating and is still considered the 
most effective means of accomodating voice traffic but can 
also be used for data transmission. Examples of circuit 
switched networks include the public telephone network and 
the Department of Defense (DoD) Automatic Voice Network 
( Autovon) . 
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2. Message Switching 

In message switching, transmission of data takes 
place in what is known as "store and forward" procedure. 
Unlike circuit switching, only one channel is used at a time 
for a given message transmission. The message proceeds from 
the source to another node in the network according to a 
predetermined route depending on source and final destina- 
tion. When the message arrives at a node it is stored. It 
may be forwarded immediately to the next node in its path, 
or if no channels are available, it is placed in a queue of 
messages awaiting transmission and forwarded when the 
channel becomes available. The message proceeds through the 
network in this manner until it arrives at its destination. 
This way, the message only needs to occupy one channel at a 
time rather than the entire path from source to destination. 
This frees up channels for additional message transmission. 
The DoD Automatic Digital Network (Autodin) is an example of 
a message switching network. 

3. Packet Switching 

Packet switching is very similar to message 
switching in that it relies on the store and forward tech- 
nique for message transmission. A major difference is that 
the messages are broken down at the source into smaller 
parts known as packets. These individual packets are then 
transmitted through the network in a manner similar to 
messages in a message switched network. When all of the 
packets reach the final destination, they are reassembled 
back into the form of the original message and it is sent to 
the individual user. The individual packets of a message may 
take very different routes in reaching the destination 
allowing them to avoid long delays at a node. With the 
possibility that the packets may follow different routes 
simultaneously, significant savings in message delay can be 
realized. This also leads to the possibility of out of 
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sequence arrival at the destination. To remedy this, each 
packet has some identifier as to what message it belongs to 
and in what order the packets are to be reassembled at the 
destination. Specific attributes of packet switched 
networks will be explained more fully later in the chapter. 

B. HISTORICAL DEVELOPMENT OF PACKET SWITCHED NETWORKS 

Packet switching technology was not really an invention 
but rather a reapplication of basic dynamic allocation tech- 
niques used for over a century by telegraph and torn paper 
tape switching systems [Ref. 2: p. 1307]. These techniques 
had traditionally used manual sorting and routing decisions 
and were therefore considered to be less efficient than 
circuit switching techniques. In order for packet switching 
techniques to show the necessary efficiency, both computer 
processing power and buffer storage resources are needed at 
each network node. The resulting economic tradeoff was 
simple: if lines are cheap, use circuit switching; if 
computing is cheap, use packet switching. With significant 
drops in the price of computing power, packet switching has 
become the economical choice. 

The first published description of what is now known as 
packet switching was an eleven volume analysis written by 
Paul Baran of the RAND Corporation [Ref. 3] in 1964. This 
report showed significant advantages in the use of packet 
switching in terms of speed and cost but sat largely ignored 
for several years. Independently, but almost concurrently, 
the Advanced Research Projects Agency (ARPA) was interested 
in linking time-shared computer facilities together through 
a widespread communications network. Soon the details of a 
store-and-forward switched network similar to what was 
proposed by Baran were conceived [ Ref. 2: p. 1308] . It was 
later that the two developing groups learned of the other's 
efforts. 
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Even though significant economic advantages were 
expected with packet switching, the communications world was 
hard to convince. In 1967 ARPA published a plan to link 
computer facilities together. Minicomputers, used as dedi- 
cated switches, were to be interfaced with the computing 
facilities and interconnected by leased lines. In 1968, 
Bolt, Beranek, and Newman, Inc. (BBN), was awarded a 
contract to develop the network. In December, 1969, a four 
node network was installed and operating. The network 
expanded rapidly and by March of 1977, 111 nodes were oper- 
ating, linking thousands of facilities and users involved in 
various research and development programs. 

The Department of Defense (DoD) recognized the potential 
benefits of using this ARPANET technology and in 1982 the 
Deputy Secretary of Defense ordered the termination of a 
program to be used for DoD data communications (AUTODIN II) 
(Ref. 4]. Instead, service heads were to proceed with the 
implementation of the Defense Data Network (DDN) which would 
utilize ARPANET technology and would integrate all DoD data 
communication users into a common network. Presently the 
DDN consists of several networks devoted to particular 
groups of users with the capability of interconnecting users 
of different networks by using what are commonly called 
'gateway' nodes. The network is continuing to expand and 
presently consists of hundreds of nodes and covers all of 
the United States, Japan, Korea, the Philipines, as well as 
several NATO countries [Ref. 5: p. 3,4]. The ARPANET still 
exists as a subnetwork of the DDN, devoted to research and 
development. 

Several countries have developed government and publicly 
sponsored packet switched networks including France, Canada, 
Australia, and the United Kingdom [Ref. 2: p. 1309] and 
their number and geographic coverage continues to expand. 
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C. PACKET SWITCHED NETWORK BASICS 



1. Background 

Figure 2. 1 illustrates the components of a basic 
packet switched network. The "user terminal" could have a 
variety of forms such as a teletype keyboard and printer, an 
interactive data and graphics CRT terminal, a telephone 
handset and associated digital interface, or a software 
process in a computer. It could even represent a whole inde- 
pendent local network joining multiple user facilities in an 
office or school campus. 




Figure 2. 1 Basic Packet Switched Network. 

The "host computer" in Figure 2. 1 provides the user 
terminals attached to it, all of the services and transla- 
tions needed to get their data to and from the network. The 
host will provide packetizing and depacketizing service for 
"dumb" terminals and lesser services for "intelligent" 
terminals or networks. 

The host computers are joined to network nodes via 
some type of transmission media. These nodes have relatively 
powerful switching and routing control computers which 
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receive, sort, store, and forward packets to the network 
using route selection algorithms which accomodate network 
conditions and performance objectives. These nodes are 
linked to several other nodes with various types of trans- 
mission media. Note that there are several different routes 
for data to flow between the two users depicted. 

The network may utilize one or several different 
routes during a network session in order to efficiently use 
the network resources. Here lies one of the most powerful 
attributes of packet switched networks. 

Each packet received at an intermediate node is 
typically stored in a buffer queue until processing capacity 
is available to decide what to do with the packet. When the 
packet is at the head of the queue, the processor examines 
the packet for its destination address and decides what node 
to send it to next and places the packet in a queue awaiting 
transmission via a particular link. Each of these operations 
takes time, thus contributing to the end-to-end delay for 
the packet or packets to traverse the network. 

2 . Packet Structure 





HEADER 

HEADER 


POSSIBLE HEADER ITEMS 




ERROR CHECK 


Source Address 




DATA 


Destination Address 
Packet Time Stamp 




DATA 

ERROR CHECK 


or Sequence Number 
Packet Type 
Ac know 1 edqeme nt 
Negative Acknowledgement 



Figure 2.2 Structure of a Typical Packet. 
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Figure 2. 2 illustrates a typical packet format as 
constructed by a host computer. After the digital informa- 
tion source associated with the user terminal has produced 
enough bits to fill the "data" bits field, the host attaches 
a carefully formatted block of header items. The error 
check field typically contains a "checksum" generated by 
Cyclic Redundancy Check (CRC) hardware/software at the 
computer connected to the originating node. This CRC charac- 
terizes all the information according to a specified 
pattern. Intermediate or destination switching computers may 
calculate the same checksum on the received bits and if any 
disagreement exists between calculated and received error 
check field then it can be assumed that bit errors occurred 
in transmission. The action that the node takes will depend 
on the nature of the data. Some data, such as a computer 
file or a banking transaction, may require to be error free. 
In this case the node will request the sending node to 
retransmit the packet. This is normally done by sending a 
negative acknowledgement (NACK) or if no acknowledgement is 
received by the sending node after a certain time period, 
the packet will be retransmitted. Packet switched speech, on 
the other hand, may not be significantly affected by a 
modest number of errors so any errors detected in the data 
can usually be ignored. Errors occurring in the header must 
not be ignored as it may create problems in packet 
recont ruction. 

All of the necessary packet switching transactions 
within and between terminal hosts and networks are governed 
by defined sets of rules called protocols. In essence, 
protocols provide the participants with a standardized 
vocabulary of message exchanges and responses needed to: 1) 
initiate a communication session with a destination; 2) 
request and receive transmission capacity; 3) format, 
transmit, and acknowledge packets; and 4) terminate the 
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session. A well designed protocol enables packet switched 
communications between completely different host computers 
in much the same way that a high level computer programming 
language such as Fortran or Pascal enables software systems 
to run on dissimilar machines. More on protocols later. 

3. Routing Techniques 

In a large, highly connected packet network there 
can be many possible paths between a source and destination. 
Tremendous amounts of research has been devoted to finding 
the "best" path between two points in a network, where 
"best" can be defined as minimum length, minimum delay, 
least cost, least number of hops, maximum flow rate or some 
combination of these. Each node has a degree of independence 
in choosing the next node in order to achieve the best path 
in the end-to-end sense. Various adaptive techniques have 
been used to permit nodal processors to account for large 
scale network conditions such as regions of temporary 
congestion or link outages in order to try to improve the 
end-to-end quality of paths. 

Often a fixed or static routing table is used where 
each source-destination pair is evaluated and a best path is 
developed and placed in a table. In this way, when a desti- 
nation node notes a packet's destination, it merely checks 
the table and sends the packet to the designated node. This 
is simple but due to the growth of large networks, changes 
to links and nodes occurring more frequently, and instances 
of temporary congestion, the result is frequent poor 
performance in packet delivery [Ref. 6: p. 115]. Because of 
this, almost all long-haul packet switched networks use some 
sort of dynamic routing algorithm which bases the routing 
decision on measurements or estimates of the current traffic 
and topology of the network. Table I [Ref. 7: p. 12] lists 
recognized requirements for Packet Switched Networks. 
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TABLE I 

PACKET SWITCHED NETWORK ROUTING REQUIREMENTS 



Message routing should ensure rapid and error free 
packet delivery 

Routing strategy should adapt to changes in network 
topology resulting 

from node and communication link failures 

Routing techniques should adapt to varying source/ 
destination traffic 

loads 

Packets should be routed around congested or blocked 

nodes 

Packets should be routed to their destination via some 
least cost method 

A technique for detecting looping and 'ping-ponging' 
should be included 

Routing techniques should be as simple as possible to 
minimize hardware 

and software requirements 

The DDN uses a routing strategy known as adaptive 
directory source routing [ Ref. 6: p. 121] . Each node sends 
a packet to all other nodes every ten seconds called a Link 
State Packet (Ref. 8: p. 93]. This packet contains informa- 
tion about the state of a node's links with all its neighbor 
nodes in terms of delay for a packet to be sent along that 
link. A simple but elegant broadcasting technique known as 
intelligent flooding ensures that all nodes receive the Link 
Status Packet. Upon receipt of each new Link Status Packet, 
the node develops a new routing table for sending normal 
packets traversing the network. This table generation 
requires an efficient but complete database that enables 
each node to essentially have a complete map of the network. 
It also must attempt to maintain consistent network mapping 
from node to node [ Ref. 9] . 

4. Virtual Circuits and Datagrams 

There are two basic kinds of service that a packet 
network can provide in terms of how it delivers packets. In 
datagram service each packet is treated as an independent 
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entity known as a "datagram". Each datagram is routed and 
delivered independently even though a message from a source 
to a destination may consist of several packets. The use of 
this scheme requires each packet to contain all the informa- 
tion necessary for its routing including source, destina- 
tion, message identifier, a sequence number, and any other 
information required by the routing scheme. Because of this, 
datagram service has a high probability of delivery but not 
an absolute probability. There is a chance that one can get 
lost with the destination having no knowledge that it had 
ever been sent. Also the message reconstruction requires 
that all packets be ordered properly before message delivery 
can occur. 

By contrast, the virtual circuit is a sequential 
service, that is, the packets arrive at the destination in 
the same order in which they entered the network. This is 
guaranteed by requiring that all of the packets follow the 
same route as the first packet. This is accomplished by a 
circuit set-up. The originating host sets up buffer space 
along an entire path to the destination. When the destina- 
tion acknowledges that it is ready to receive the message, 
the packets are sent in sequential order. In this case, each 
packet needs only to identify to what virtual circuit it 
belongs to and the different switching nodes will automati- 
cally route it through the links that correspond to its 
virtual circuit. After the last packet, a circuit termina- 
tion procedure occurs which frees up the resources for other 
use. A virtual circuit requires less overhead bits per 
packet but at the expense of call set-up and termination 
times. It is absolutely reliable in packet arrival but lacks 
some flexibility in routing should a failure occur during a 
virtual circuit session. Another benefit is that it reduces 
routing burden at each switching node. 
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A virtual circuit resembles the circuit switching 
technique in the sense that the circuit is set up and termi- 
nated and that all packets of a message traverse the same 
route but differs from it significantly in that more than 
one virtual circuit may simultaneously share the same link 
as part of its message path. Another important difference is 
that if a link or node does fail, alternate routing can 
occur resulting in delay but not in lost communications as 
would occur in the case of circuit switching. To the user, a 
virtual circuit appears to be a dedicated line. 

Two advantages frequently given to to datagram 
service are improved routing reliability and lower cost. Due 
to advanced switching and storage capabilities at nodes, 
link or node failures no longer result in lost packets and 
the packet retransmissions they cause in the case of the 
virtual circuit. Drops in memory and switching costs result 
in the extra overhead associated with datagram service 
becoming a major cost factor. A datagram requires about 25 
bytes of header in addition to the actual data ( 0 to about 
128 bytes) whereas only about 8 bytes are required for 
similar packets in a virtual circuit. Messages requiring 
more than one packet cause overhead to contribute 13 to 94% 
to the total transmission costs in the case of datagrams 
[Ref. 2: p. 1311]. 

5. Protocols 

The design, development, and standardization of 
packet system protocols has received a great deal of atten- 
tion. Protocols exist to ensure that communicating entities 
can send, receive, and interpret the information that they 
wish to exchange. Protocols play three fundamental roles: 1) 
they establish standard data elements; 2) they establsh 
conventions; and 3) they establish standard communication 
paths. Data elements include character, messages, files, 
jobs, and graphic displays. Conventions include code sets. 
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packet formats, transmission speeds, and control messages. 
Standard communication paths can include functions such as 
addressing, priorities, sequencing, error control, flow 
control, and session initiation and termination. 

Two protocols in extensive use today include the 
International Standards Organization (ISO) Open System 
Interconnection 7-layer architecture and the CCITT X. 25 
protocol. In the ISO model, the highest layers govern end- 
to-end interaction between users or internal processes and 
the lowest layers govern the operation of the media carrying 
the actual signals on the individual links. Intermediate 
protocol layers apply to switching nodes and intermediate 
processes. The 7-layer architecture is designed for virtual 
circuit service but work has been done to include datagram 
service. Table II shows the 7 layers. For a more in-depth 
explanation of each of the layers, see Stallings [Ref. 18]. 

TABLE II 

ISO 7 -LAYER PROTOCOL 

7. Application Layer 
6. Presentation Layer 
5. Session Layer 
4. Transport Layer 
3. Network Layer 
2. Data Link Layer 
1. Physical Layer 

The CCITT X. 25 protocol was first agreed upon inter- 
nationally in March 1976 and like other standards, continues 
to evolve [Ref. 2: p. 1310] . It is a three layer protocol 

with the layers closely corresponding to the 3 lowest layers 
of the ISO protocol (physical, data link, and network). The 
layers are named physical layer, data link layer, and packet 
layer. Higher layers are provided by the user's application 
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For a more 



software. X. 25 is a virtual circuit service, 
in-depth look at X. 25 see Rosner [Ref. 11]. 

The DDN uses a protocol similar to those above, but 
because it is designed to work in an internet environment 
(where source and destination reside on different networks), 
the provision of error-free, end-to-end transmission becomes 
more complicated. The DDN uses internet standards called 
Internet Protocol ( IP) and Transmission Control Protocol 
(TCP) which operate at the user level. Error checking is 
included such that end user processes can detect errors that 
were introduced at some (possibly unidentifiable) interme- 
diate node and request retransmission by the source. 

Protocols are necessary to allow user-to-user commu- 
nication and thus are highly desireable. Standardization is 
also desireable because of widespread differences in users 
and their needs as well as the existence of many organiza- 
tions involved in standard development. It is often the case 
where "universal" standards or families of standards are 
developed and adhered to by some and ignored by others. 

6. Flow and Congestion Control 

Certain similarities exist between packet switched 
networks and traffic on major highways. A large number of 
users (cars or packets) share the resources of the network. 
Unless careful control is exercised over user demand, 
capacity may be exceeded. During rush hour, the number of 
cars often exceeds highway capacity creating long lines at 
highway interchanges. Interference between "through" traffic 
and traffic using on and off ramps reduces the throughput of 
the highway. If the situation persists, traffic may come to 
a standstill. This is a good example of the relationship 
between offered load and throughput. After reaching system 
capacity, if offered load is increased, throughput drops 
off. Some means of controlling the offered load to prevent 
the system from exceeding the overload point is needed. 
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Just as highways use access ramp control lights to 
limit flow onto the highway, packet switched networks need 
some similar controls. These are frequently called flow and 
congestion control. There are some subtle differences 
between flow and congestion control. Flow control is princi- 
pally involved with controlling the rate at which packets 
flow to prevent their arrival rate from exceeding the rate 
that a processor can handle them. Flow control can be 
defined as a system of algorithms used in a network to 
prevent a user or group of users from monopolizing resources 
to the detriment of others. 

Flow control can take place between neighboring 
nodes, end-to-end users, or source to destination switches. 
Three types of flow control are generally utilized in 
networks [Ref. 12: p. 107] : 

1. Rate: The source is restricted to sending only up to N 

packets per second. 

2. Window or Credit: The sending node may send up to W 

packets before receiving an acknowledgement. No more 
than W unacknowledged packets may exist between source 
and destination. 

3. Stop and Go: A source sends packets at its maximum 

rate, stops, then repeats. This can be controlled by a 
timer or more commonly, by a feedback packet from a 
downstream node or destination. 

Flow control methods can be either or dynamic. In 
static control, some constant level of restraint exists in 
the network at all times. This is simple, but overly 
restrictive in terms of network throughput under light 
loads, and conversely, may be insufficient during peak 

periods of many users. Dynamic controls apply variable 
levels of flow control ( e. g. changes in window size), 
depending on network conditions. This variability can 
either be in response to changes in load or can be anticipa- 
tory estimates of short-term future load. The network 
responds by inducing flow restriction before the increased 
load degrades the network. The ideal response of a flow 
control system would be to immediately reduce traffic load 
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to the maximum manageable level upon sensing an overload 
limit being reached. This ideal is not achievable due to the 
fact that a finite time is needed for flow control actions 
to take effect. If flow control actions are too strong, 
large load oscillations can occur as the network cycles 
between overload and underload. 

This can have two negative consequences in terms of 
network usefulness and throughput. If the load is too high, 
a decline in effective network capacity occurs resulting in 
reduced throughput. This may also cause user dissatisfaction 
resulting in long term drops in demand. On the other hand, 
if the load is too low due to overcontrol, the network is 
not even attempting to carry offered load so throughput is 
reduced here also. 

Determining when and to what degree the flow control 
should respond are complex questions. Oscillations can even 
occur when no measurement error exists due to discrepancies 
caused by time lag. Instantaneous load estimates based on 
queue length aren't reliable and smoothing load estimates 
over multiple intervals is not perfect due to the existence 
of "old" information remaining in the estimate that the 
system may have already corrected for [Ref. 12: p. 113] . 

Even with flow control existing between parts of the 
network, too many packets can still be present in parts of 
the network causing congestion. Long queues can build up at 
nodes and can eventually result in deadlock. Deadlock is 
when two or more nodes are trying to send each other packets 
but, due to full buffers, none of the nodes can accept 
packets. This problem has been solved in centrally 
controlled networks but distributed networks must frequently 
rely upon deadlock detection methods and purge the locked-up 
traffic. This ends the deadlock but causes destroyed 
packets. Congestion control is then needed and normally uses 
some method of network access restriction and deadlock 
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detection/correction. Flow and congestion control should 
ideally have all of the attributes shown in Table III It is 
impossible to obtain perfection in all attributes because of 
counterbalancing effects but a proper mix is needed to meet 
the performance objectives of the network manager and users. 

TABLE III 

FLOW AND CONGESTION CONTROL CRITERIA 
-Effective 

-Sensitive to traffic patterns 

-Fair to all users 

-Stable (not wildly oscillating) 

-Responsive 

-Minimal network overhead 

-Robust (able to handle a varity of network conditions) 

It is plain to see that congestion and flow control 
go hand-in-hand and must be integrated together. Routing 
algorithms also interplay with flow and congestion control 
resulting in a level of system performance. A lot of litera- 
ture and even whole conferences have revolved around the 
topics of flow and congestion control. Readers interested in 
a more in-depth explanation of methods than can be offered 
here should read Sevcik [ Ref. 13] and Kleinrock [ Ref. 14] . 

D. NETWORK MANAGEMENT 

Managing a large communications network involves a 
myriad of decisions. The decisions occur at every level of 
use and every network location. Many of the decisions were 
made at the time of network development and are programmed 
into network node software. Others were not. Infrequently 
expected events are often best handled by network operators. 
Too many factors affecting a decision or even oversight may 
require operators to make network management decisions on a 
case by case basis. 
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Some management schemes are centralized, others are 
distributed. In a centralized system, at any given time, 
the controlling element is the responsibility of a single 
entity or node in the network. In order to ensure reli- 
ability, a number of different stations can assume the role 
of network manager but only one at a time. All others serve 
as alternate managers. 

Distributed control means that network management is 
divided among many, and perhaps all, entities within a 
network. Examples are a switch performing independent 
routing and a switch detecting a fault and performing 
internal diagnostics. Distributed control tends to be very 
robust since it doesn't depend on control from a single 
outside entity. However it does tend to be less than 
optimum since each entity makes decisions based on a very 
limited picture of the entire network. 

The control may be either passive or active [Ref. 11: 
p. 145] . Active control means the controlling elements are 
continously evaluating network performance and are taking 
real-time actions to ensure that the network is operating 
optimally. Active control allows maximum utility to be 
derived from network resources but the entire network may be 
severely affected if the control capability becomes 
defective. 

In passive control, the controlling elements are effec- 
tively in the outside of the network, looking in. The 
network is designed to be self-sufficient and the control 
tends to be long-term, hence probably not optimal at any one 
given time. 

An effective management scheme normally combines all of 
the characteristics, that is, it includes centralized and 
distributed control attributes using both active and passive 
control methods to manage the network. Network management 
can be defined as a real-time surveillance and control 
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activity utilizing techniques to optimize use of network 
capacity under stress due to traffic overload factors. It 
employs automatic and manual capabilities which recognize 
the onset of overloads and respond with traffic control 
actions within a time range of seconds for automatic 
controls to minutes for manual actions. 

1. Control Functions 

Table IV [Ref. 11: p. 143] summarizes the network 
control functions that must be performed. Here again, 
perfection in all areas is impossible and tradeoffs are 
necessary in actual networks. 



TABLE IV 

ROLE OF NETWORK CONTROL IN A PACKET SWITCHED NETWORK 



Assure Network Integrity 

- Connectivity 

- Reliability 

- Restoration 

Maximize Throughput 

- Effective routing strategy 

- Effective flow and congestion control 

Monitor Abuses and Malfunctions 

- Privacy and security 

- Prevent misrouting 

- Prevent disruption and spoofing 

- Data accuracy 

Cost Recovery and Billing 

- Traffic quantity 

- Resource usage 

- Delay and precedence data 

Planning Data 

- Traffic growth 

- User sensitivities 

- Traffic patterns 



2. The Network Monitoring Center 

In a typical packet switched network such as the DDN 
minute-to-minute network operations fall under distributed 
controls located at the individual switching nodes. A 
Network Monitoring Center (NMC) is used for exceptions to 
the norm. In the DDN, the NMC monitors network element 
status, topology, and performance [Ref. 5: p. 70] . When 
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necessary, an operator can exert control via operator 
commands sent to "fake" hosts that reside at network nodes. 
In this way, the commands can be sent via message packets 
along normal network routing. Supervisory and control data 
can also be sent on separate lines in an order-wire fashion 
or in out-of-band signals using portions of the link band- 
width allocated specifically for control. 

The DON NMC can perform numerous functions, some of 
which are outlined below. 

1. Assign network resources: Since resources must be 

shared, some networks try to be fair while others 

provide different users privileged access in a priority 
scheme. This may preempt those currently using 

resources in order to serve high priority users. 

2. Ability to load switching software at nodes remotely 
from the monitoring centers. 

3. Database Management: Includes updating and maintaining 

static and dynamic information on network elements. 

4. Adaptive Presentation: Data can be screened or filtered 
for special attention and categorize it for individual 
users or files. 

5. Communicate securely to other nodes to avoid spoofing 
or unintentional network control actions. 

6. Establish Thresholds: Distributed controls may handle 

problems up to a certain threshold but once exceeded, 
the monitoring center may act. Actions may be in the 
form of establishing additional diagnostic performance 
monitoring when an unidentified fault is indicated or 
even complete fault detection, isolation, and correc- 
tion. 

Monitoring centers of large networks are normally 
manned 24 hours a day to handle problems when the need 
arises. Normally several monitoring centers are manned, some 
as primaries and others as alternates. Mobile monitoring 
centers are available in the DDN should a crisis occur and 
network reconstitution be needed due to normal monitoring 
centers being destroyed. 

3. Summary 

Packet switched networks are simple in nature but 
complex to implement. Many factors affect its performance 
and optimizing one may detrimentally affect another. 
Parameters must be monitored to detect problems and 
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to ensure 



appropriate control measures taken in real-time 
user satisfaction in a large network. 
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III. MEASURING NETWORK PERFORMANCE 



A. INTRODUCTION 

Because networks do not possess infinite speed and band- 
width with zero chance of error and are not built of compo- 
nents with an infinite lifetime, we must monitor network 
parameters to determine its performance. Present technology 
allows us to approach these limits but budget constraints 
and common sense tell us that we can normally survive 
without perfection. 

In determining how well a network is performing, there 
are two fundamental questions that must be asked; "What 
should we measure ?" and "How should it be measured ?". Let 
us look at the second question first. 

B. HOW SHOULD WE MEASURE ? 

There are three methods for determining the performance 
of a network [Ref. 15: p. 19] : 

1. Mathematical Modeling 

2. Simulation 

3. Data extraction from the system itself (on-line 
monitoring) . 

Mathematical modeling employs theories of queuing and 
flow by describing certain network characteristics in sets 
of mathematical equations. This is a complex problem and 
often assumes away critical parameters. These assumptions 
are the principle disadvantage with mathematical modeling as 
too many assumptions impose an unacceptable level of 
abstraction. Although the validity of these modeling tech- 
niques is proven, the methodology is often understood only 
by the modeler [ Ref. 15: p. 19] . 

The second technique, simulation, is an abstraction of 
concepts fundamental to the problem. Characteristics of 
nodes and links and the algorithms that control message flow 
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are developed into a computer program. The operator, in 
running the program, can inject messages of various lengths 
and rates along different routes and observe how the network 
responds. Node and link failure can be introduced as well as 
changes to the component characteristics and further network 
response can be observed. 

Mathematical models serve to show the best performance 
that a network can exhibit while simulation can provide a 
better "global" view of the network's response in real 
scenarios. In allowing network designers to observe how 
network characteristics contribute to performance, intelli- 
gent decisions concerning design or control alternatives can 
be made. These methods help us to tell if a network contrac- 
tor's specifications will be true when a system is fielded 
and to see how a network responds to scenarios that we don't 
want to impose upon an actual operating network. 

In a typical network simulation run [Ref. 15: p. 77] , a 
statistics package collects and collates vital data such as: 

1. average number of packets at a node 

2. average number of packets on a circuit 

3. percentage use of a circuit 

4. average delay over a route 

5. number of packets reaching a destination and time asso- 
ciated with them 

Real network performance can be evaluated as well as the 
impact of changing a buffer size or deleting a link or node. 
The major problem lies in the validity of the model. With 
valid models we can gain confidence in a network's ability 
to meet users' needs, as design by trial and error can be 
expensive for a major network. 

The last means of measuring network performance, on-line 
monitoring, is the most ideal and is the major focus of this 
thesis. With data extracted from an operating network, the 
network manager can fulfill certain objectives such as fault 
detection, isolation and repair, billing, traffic 
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administration, resource management, system tuning, mode and 
link evaluation, as well as network model evaluation 
[Ref. 16: p. 201]. It also allows us to analyze delay and 
capacity statistics for developing new control algorithms 
and predict future demands and user needs, as well as for 
determining baseline network performance levels as was done 
in the telephone industry just prior to the divestiture of 
the Bell System [Ref. 17]. 

Although on-line monitoring may be the ideal means, it 
is not without problems. First off , the network must exist. 
The monitoring system often interacts with the network which 
adds to the system load and affects the neutral influence an 
optimal monitor should have. Also since evaluating the 
entire network is too difficult of a task, statistical 
sampling is done. This introduces a degree of error 
depending on sample size and its degree of randomness. 

C. WHAT DO WE MEASURE 

Network performance parameters have been monitored for a 
long time in trying to meet the objectives stated previ- 
ously. Historically, many of the parameters originally 
developed as performance measures such as grade of service, 
frequency response curves, and frequency shift were devel- 
oped for circuit switched, analog systems. These parameters 
no longer fit the characteristics of modern distributed 
digital packet-switched networks. 

Before determining what to measure, another question 
must be answered - for what reason are we measuring perform- 
ance? Although the particular parameters may be similar in 
any case, how we group them, how we use them, and with what 
accuracy do we measure them will certainly vary. This 
concept will be further expanded in the next chapter when a 
network performance measure is developed with the idea of 
enhancing the benefits to the end user. Performance parame- 
ters generally fall into categories concerning throughput. 
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which is the usable rate at which data can flow from point 
to point; delay, which is the time it takes for data to get 
from point to point; and error performance, which is the 
degree to which the data arrives at the destination free 
from error. Another category will be discussed here which is 
a catch-all category, "other factors". These include jitter, 
link or node status in terms of availability, queue length, 
statistical information for later evaluation, and figures 
relating to measurement error. 

1. Throughput 

Throughput is the effective rate at which data can 
be sent and is typically measured in bits per second (bps). 
It can be analyzed from several viewpoints. Effective 
throughput for a link is useful so a network manager can 
determine if a problem lies in a particular area of the 
network. Effective end-to-end throughput is important to the 
manager in terms of providing a certain level of performance 
and is important to the user who needs a minimum level in 
order to meet his needs. 

The maximum throughput of a link is determined by 
characteristics of the transmission medium, distance, and 
the signalling technique. Simple media such as twisted pair 
can provide high data rates but only for short distances due 
to loss, noise pickup, and signal distortion. As an example, 
twisted pair will pass about 10 million bps ( 10 Mbps) for a 
distance of 100 meters dropping off to about 10 thousand bps 
(10 Kbps) for a distance of 1200 meters [Ref. 10: p. 49] . 
Twisted pair is thus not too useful for the long haul 
networks we are interested in. Coaxial cable, due to 
superior frequency characteristics compared to twisted pair, 
can support data rates in excess of 100 Mbps but require 
in-line amplifiers every 1000 meters. This can be very 
expensive for long haul applications. Optical fibers are 
becoming more widespread in use for long haul telephone 
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communications. Such fibers can pass over 2000 Mbps for tens 
of kilometers, are smaller, lighter in weight, have lower 
attenuation than wire cables and are unaffected by external 
electro-magnetic fields. Bell Laboratories has successfully 
tested a 119 kilometer link at 420 Mbps which required no 
repeaters [Ref. 18: p. 53] . 

Microwave links are capable of passing several 
hundred Mbps over line-of- sight paths and are widely used 
where cable right of ways can't be obtained, and over 
terrain where cable laying would be difficult. 
Geosynchronous satellites are widely used for long haul 
international links and can provide data rates in the range 
of tens of Mbps but at a cost of about 1/4 of a second in 
transmission delay to and from the satellite. 

These data rates specified are maximum rates of the 
links. Factors will reduce the effective rate of data trans- 
mission. Typical packet lengths are on the order of 1000 
bits. Since part of the packet is overhead, actual user data 
in the packet is reduced. If large packets are used, effec- 
tive user throughput increases for a constant number of 
overhead bits per packet. 

Because many users may be trying to communicate on 
the network at a particular time, the effective data rate 
must be divided amoung the users as their respective packets 
await transmission. If any prioritization of users is 
utilized, effective data rate for lower priority users is 
further reduced. As the number of users increases, so does 
the network congestion they cause. Network flow control 
adjusts the the rate at which packets are injected into the 
network to avoid network overload. This helps to ensure a 
reasonable data rate for all and avoids the limited data 
rate that exists when the network is overloaded. If errors 
occur and packet retransmission is required, effective data 
rate is lowered, but proper use of error detection/ 
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correction and low-error media can keep this to a minimum. 
All these factors contribute to the lowering of the effec- 
tive data rate from the maximum allowed by the medium. All 
is not lost, for in a network with a rich topology, numerous 
parallel paths exist between source and destination which 
contribute enormously to the effective user-to-user 
throughput. 

2. Delay 

There are several classifications of delay. Some 
deal with delay at a node or delay through a link, still 
others measure end-to-end delay. About the only thing in 
common with these is the measurement units, seconds. Any 
delay along the route from source to destination affects the 
overall delay. A delay occurs when the user first tries to 
access the network. The network host and/or interface must 
recognize the user as a valid, retrieve the user's account 
files, determine the user's intents and then set up connec- 
tions to destination or necessary resources. 

Data delay due to transmission time is on the order 
of 50 to 100 milliseconds for continental coast-to-coast 
terrestrial links and connections involving satellite links 
undergo delays of about 270 milliseconds as the signal goes 
up to the satellite and back down. Delays occur at each 
node as the packet is received, processed, stored in a 
queue, and then forwarded on to its next destination. The 
number of nodes that a packet must pass through may increase 
during periods of network congestion and with certain 
routing schemes, multiplying the delay accordingly. 

Factors contributing to delay include processor 
speeds, congestion and the resulting queueing delays. As 
packet length increases, the longer it takes for packet 
reception, processing, and forwarding as well as being 
subjected to longer delays for a given queue length. This 
can be further compounded if a priority system is involved 



37 



and the user is a low priority user. Although transmission 
delays are generally considered minimal, under low 
congestion conditions, it can be a dominant factor if the 
links include satellite hops. Delay can be an overriding 
concern for certain user groups, particularly packet 
switched voice and interactive processing users. It is of 
less concern to user groups involved in periodic large data 
file transfers or connectionless services such as electronic 
mail. 

There are several techniques that can be used to 
measure aspects of network delay ( Ref. 19 , 20] . Network 

delay performance based on actual delay measurement is 
frequently used. Either a sampling is made of the beginning 
and ending "time stamps" of existing packets at various 
nodes or else an artificial packet is generated at a host 
and sent to some "fake" host residing at a destination 
switch. This packet is echoed back to the originating host 
so it can determine the packet's elapsed lifetime. Extensive 
delay testing is normally performed when a major network 
component is changed, added, or deleted. A more indirect 
measure of delay can be made by sampling queue lengths at 
various nodes and comparing their statistical parameters to 
some baseline. 

3. Error 

Error performance standards, or more accurately, 
freedom from error, have been the subject of much animated 
discussion amoung several standards organizations including 
CCITT and the American National Standards Institute (ANSI) 
[Ref. 21: p. 13.6.2). Three quantities have been mainly used 
as measures of error performance [Ref. 22: p. 2.D. 1.2] : 

1. Bit Error Rate (BER) 

2. Percentage of time where BER does not exceed a given 
threshold value, BER*,(TI). 

3. Percentage of error-free seconds (EFS). 
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BER is defined, in relation to a given measurement 
time period, as the ratio of errored bits to total trans- 
mitted bits. TI is defined as the percentage of measurements 
where BER is less than or equal to BER*. Having adopted a 
measurement period of T(0), the percentages are assessed 
over some time interval T(l), where T( 1 ) is much greater 
than TO. EFS is defined in relation to measurement periods 
of one second and is expressed as the percentage of error- 
free measurements assessed over a time interval of many 
seconds. A related parameter is EFdS which is the same as 
EFS only in this case, the measurement period is one decise- 
cond (1/100 of a second). 

Bit error rate is the predominant error measure 
where errors occur at random times such as on satellite 
links. It has been found that on terrestrial radio and cable 
facilities, errors are not statistically independent so EFS 
has been found to be a more suitable measure in these 
instances. TI has been seen as a suitable measure in the 
case of digital telephony where the quality degradation due 
to errors may be roughly compared to additive noise propor- 
tional to a constant BER over the duration of a call. 
Degradation has been found to be negligible for BER better 
than 10~®. [Ref. 22: p. 2D. 1. 2] . 

A fourth error performance measure has been under 
consideration but has not received much international 
support which is the percentage of error-free messages 
(EFM). It is normally defined in relation to a typical data 
message (packet) size of 1000 to 2000 bits. Some feel that 
since it is independent of the channel bit rate, it may 
serve the measurement requirements of data users more accu- 
rately than EFS in the case of high channel bit rates (i.e. 
>1. 5 Mbps). 

Using a suitable measure of error performance, three 
network components are typically monitored [ Ref. 19: 
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p. F6. 5. 3] ; node, trunk, and access link. Node error occurs 
when a correctly received packet is transferred containing 
an error. Trunk error has two associated parameters; trunk 
packet error which is when the CRC check fails on a received 
packet compared to the total number of packets received, and 
trunk packet retransmission which is the number of retran- 
smitted packets compared to the total number of packets 
transmitted. Retransmission rate is typically higher as 
retransmission can occur for a number of reasons other than 
CRC errors such as buffer overflow and loss of acknowledge- 
ments. Similarly, there are two parts to access link error 
performance; link frame error rate and link frame retran- 
smission rate. 

Another error rate is also typically quoted which is 
based on undetected packet errors. Continous measurement of 
this parameter would be difficult for obvious reasons. 

Error performance is typically based on error 
statistics collected from various components of the network. 
They are typically reported to a controlling station in such 
a way that high error rate components can be identified. 
Data applications require a significantly better error 
performance than voice applications in order to be 
effective. 

4. Other Parameters 

In addition to the previously mentioned performance 
parameters, several others are frequently used. Availability 
and accessibility are used interchangeability in some of the 
literature. The term "availability" will be used here and is 
generally defined as the probability that the resources of 
the network are available to the user at a particular time 
[Ref. 19: p. F6. 5. 3] . Network availability can be broken 
down into component availabilities, which are the fractions 
of a selected time interval during which the component is 
capable of performing their assigned functions. Components 
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usually monitored are line processors, trunk processors, 
user access links, and node processors. From these component 
availabilities, the node-to-node availabilities are calcu- 
lated. These represent the fraction of time that a path 
between nodes (from line processor to line processor) is 
available to set up and operate a virtual circuit or provide 
datagram service. Usually a simple arithmetic average of the 
node-to-node availabilities can be used as a network avail- 
ability index. 

Contributions to unavailability may be categorized 
as short-term or long-term due to the relative impact of 
long and short-term outages on the user. For example, a 
voice user subjected to a long term outage may impatiently 
hang up. Short-term outages disturb both data and voice 
users due to data corruption but don't usually require 
circuit restoration action by network operations and mainte- 
nance personnel. Multipath fading in radio transmission, 
resynchronization in time division multiplexing, and auto- 
matic switching of redundant equipment are all sources of 
short term outages. Long term outages consist primarily of 
catastrophic failures, although certain propagation condi- 
tions such as satellite signal fading due to rain may also 
produce long term outages. 

One organization, the CCITT, has defined a circuit 
to be unavailable when the service has degraded for periods 
exceeding a time interval ( e. g. one second average bit error 
rate greater than 10* on a 64kbps voice and data channel 
that occurs for a period greater than 60 seconds). In this 
definition, disturbances less than 60 seconds are covered 
under error performance measures [Ref. 20: p. 17. 1. 3J . 

Another performance parameter that is often deter- 
mined for a network is reliability. It is related to avail- 
ability but deals primarily with the probability of service 
interruption due to random failures. Reliability can be 
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expressed in terms of "mean time between failure" (MTBF), 
whereas availability is more closely related to "mean time 
to repair" (MTTR). Here again, component reliabilities are 
determined and combined to form node-to-node reliability 
measures. This performance measure is normally used in 
network design and implementation and not used during normal 
network operation. 

Since processors in the path of the packet determine 
the value of a bit (0 or 1) by sampling, problems can arise 
due to small variations of the sampling instant from its 
intended position in time or phase. This is known as jitter. 
Larger time variations are known as wander or drift. Jitter 
can occur at any processor along the way. The methods of 
controlling jitter below a required level are available and 
used in networks and are very complex. 

The last performance parameter to be discussed 
pertains to synchronous networks and is called "slip". Slip 
occurs when a momentary loss of synchronization occurs due 
to errors in the clocks used to control network processors. 
At high bit rates, a small variation in time measurement can 
cause slip. The result is usually a bit or packet error 
causing an occasional click in digital telephony and packet 
retransmission in the case of data [Ref. 22: p. 2D. 1.3]. 

Additional data that is normally monitored and used 
for management and operational control include queue length 
which can indicate congestion or component failure, alarm 
indications for fault troubleshooting and component utiliza- 
tion data. 

D. STANDARD NETWORK PERFORMANCE PARAMETERS 

New applications for data communication services and the 
trend toward deregulation and competition in the telecommu- 
nications industry has created a need for specifying and 
measuring the performance of these services. Various organi- 
zations have been pursuing a network performance standard 



42 



including CCITT in the international scene, numerous foreign 
national communication agencies, and U. S. organizations 
including the National Bureau of Standards, the National 
Telecommunications and Information Agency (NTIA), and the 
American National Standards Institute (ANSI). Close coordi- 
nation with industry is maintained in the process as a stan- 
dard with no followers can hardly be considered a true 
standard. Historically, network performance standards have 
been biased toward technical, network-oriented perspectives. 
Over the past several years, standards organizations in the 
U. S. have been working together in developing system inde- 
pendent performance parameters and measurement methods using 
the end-to-end users as the perspective. Standards have 
started to be promulgated within the federal government in 
the form of Federal Telecommunication/Federal Information 
Processing Standards and in industry in the form of American 
National Standards [Ref. 23: p. F6. 6. 1] . 

Two related performance standards have been developed. 
The first, American National Standard ( ANS ) X3. 102 defines 
user oriented performance parameters. The second, proposed 
Federal Standard (FS) 1043 defines companion measurement 
techniques. It is expected that these standards will promote 
innovative and fair competition in the data communications 
industry by providing users with a common denominator for 
measuring a delivered performance and comparing alternative 
network services. It is estimated that user savings of over 
$400 million per year can be realized in the total Federal 
data communication costs through the promulgation of these 
standards in the near future [Ref. 23: p. 6. 6. 1] . 

Figure 3. 1 illustrates the twenty-one user-oriented 
performance parameters defined in ANS X3. 102. Performance is 
expressed relative to three primary communications func- 
tions: access, user information transfer, and disengagement. 
Each of the functions is then considered in relation to the 
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criteria of speed, accuracy, and reliability. One or more 
"primary" parameters were defined to express performance 
relative to each criterion/ function pair. Four ancillary 
parameters are also defined in X3. 102 relating to the 
primary "speed" parameters of each function. They express 
the average portion of of the parameter's performance time 
that is attributable to user delays. For example, the param- 
eter "Access Time" can include delays attributable to the 
user such as system interrogation and user response, as well 
as delays attributable to the system such as switching, 
queueing, and transmission delays. 

These ancillary parameters have very important uses. 
They can allow for factoring out user influences on the 
primary speed parameters to produce user-independent values 
for characterizing system performance. There are three 
general applications for the X3. 102 performance standards 
[Ref. 23: p. F6. 6. 2] : 

1. User Requirement Specification: The parameters can be 

used to specify the communication performance require- 
ments of a particular user. An analyst can assess the 
impact of communication performance on user processes 
without presupposing any particular network designs. 

2. Service Performance Characterization: The parameters 

can be used to characterize the end-to-end performance 
of a system or service. This can provide vendors/ 
suppliers with a single, uniform method of representing 
performance to all potential users 

3. Service Selection: The parameters can be used to 

compare alternative means of meeting user requirements. 
Thus they provide the communications manager with a 
practical method of evaluating service utility. 

Proposed Federal Standard 1043 provides an overall 
approach used to define the measurement methods in X3. 102. 
It is written as a specification for a conceptual data 
communications measurement system consisting of four major 
subsystems [Ref. 24: p. 31] . 

The Data Extraction subsystem observes signals trans- 
ferred across user/system interfaces in real time, deter- 
mines the performance significance and its time of 
occurrence. It then outputs this performance information in 
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Figure 3. 1 Summary of ANSI X3. 102 Performance Parameters. 

the form of a chronological event history. These events 
observed at each interface provide the basis for performance 
parameter calculations. The interface monitors must perform 
three functions. The Input function detects the signals and 
determines their time. The Processing function takes these 
signals and determines the event's significance in terms of 
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X3. 102 performance parameters and the Output function then 
outputs the nature and time of each significant event in the 
form of an ASCII record for filing. 

The Data File subsystem consists of a set of standard 
ASCII character files which record the the real-time event 
histories from the Data Extraction susbsystem. They are 
available for off-line reduction and analysis. The files are 
are broken down into four sections; a source overhead infor- 
mation file^ a source user file generated by the interface 
monitor, and destination user overhead and information 
files. 

The Performance Assessment subsystem correlates the 
ASCII files into standard X3. 102 parameter values. The 
resulting output consists of five pages of data including 
parameter values, user inputs, and raw parameter data. Each 
batch of data is associated with a specific source/ 
destination/originating user triplet. In order to charac- 
terize the performance of duplex or multipoint transactions 
and multi-user networks, it is necessary to aggregate 
performance data from two or more batches to produce 
composite performance values. 

The Statistical Design and Analysis subsystem transforms 
user-defined measurement precision objectives into appro- 
priate statistical test design and data analysis criteria. 
These criteria are used to control the data extraction and 
performance assessment subsystems and produce confidence 
limits for each measured parameter value. Three major topics 
are addressed: Qualitative design ( i. e. how variables such 
as time of day, traffic loading, selected user pairs, etc. 
should be accounted for in arranging measurements); Sample 
size determination; and lastly. Data analysis ( i. e. how to 
analyze measured data to check pre-test assumptions and to 
refine measurement precision estimates). 
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Performance measurement involves a trade-off between 
benefits and cost. The primary benefit of data communica- 
tions performance measurements is an improved ability to 
make decisions about procurement and operation. These 
benefits are strongly influenced by two factors; accuracy 
and completeness with which the parameters characterize the 
service, and the extent to which the values may be compared 
with values of other services or with specific user require- 
ments. Measurement costs include loss of productive service 
usage as well as the time and resources required to obtain 
and structure the performance data. Inevitably, the more 
accurate and comprehensive measurements cost more than less 
useful ones. 

These two standards were tested using the ARPANET as a 
test-bed [Ref. 24: p. 39] . The tests were conducted over a 
two month period and the results were felt to be useful by 
network managers for performance assessment as well as 
comparing performance to user needs. These standards have 
already been utilized in a number of trial federal procure- 
ments. The standards are continually undergoing improvement 
and are being pushed for more widespread acceptance. 
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IV. A USER-ORIENTED PERFORMANCE INDEX 



A. BACKGROUND 

User oriented performance measures presently under 
development, such, as ANS X3. 102 and Federal Standard 1043, 
indicate a significant departure from typical technical 
network operation and management oriented performance meas- 
ures. One must recognize that these user oriented measures 
are not meant to completely replace the complicated network 
oriented parameters but rather to supplement them. This is 
because the user oriented measures are incomplete in terms 
of providing necessary information for network control, and 
for fault detection/isolation/correction [Ref. 25: p. 
2C. 5. 1] . These new measures such as X3. 102 are proving to 
be valuable for side by side system comparison, characteri- 
zation of the performance of a particular system, and for 
specifying user requirements. It shows great progress in 
trying to monitor performance from the user's perspective. 
If one could utilize some of the parameter characterizations 
from X3. 102 and some of the real-time monitoring capabili- 
ties of the network oriented monitoring methods, it is fore- 
seeable that an accurate, near real-time indication of 
network performance could be made available. 

Characteristics of packet switched networks are dynamic, 
so one also expects that the perceived performance of the 
network is also dynamic. For networks with finite amounts of 
resources, as the number of users increases and stretches 
the existing resources, the network manager must either 
continue to expand the network to maintain the desired level 
of performance or manage the resources and users better. In 
exercising user control, managers can either directly 
control the user or he can provide the user with a means of 
self-control. Direct control can be in the form of limiting 
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network access to a certain group of users or limiting all 
users in the rsources that they can access. Self-control can 
be in the form of a pricing policy (i.e. charge low rates at 
what are typically low usage times to encourage users to 
move away from high usage times). Normally the period of 
maximum charges is not uniformly congested so user perceived 
performance will vary. If some dynamic index of network 
performance can be made available to the user, the user can 
determine the best times to use the network and receive 
better performance for a given usage charge. Benefits for 
the user also include better time and resource usage as now 
the user can decide the extent of immediate access versus 
expected performance tradeoffs. Benefits to the network 
could be in the form of savings on the capital investment 
for resource expansion by evening out the user demand (hence 
resource usage) over time. Additional usages of providing 
the user an indication of network performance could involve 
usage pricing based on the user's effect on network perform- 
ance. In other words, charge the user higher prices when 
performance is poor to encourage him to wait. This would 
reduce the effect of additional users on the performance of 
those already using the network. 

American National Standard X3. 102 does not provide such 
a real-time user oriented performance measure but does 
provide some insight as to how to characterize network 
performance. One of its weaknesses is that it doesn't 
differentiate between user types. Networks of the future 
will likely integrate voice, facsimile, interactive 
computing, electronic mail, and large data file transfer 
services into a common network. Each of these has different 
requirements for performance in order to be effective. As 
network resources get stretched under heavy load, the 
manager may desire to tradeoff some aspects of performance 
in order to provide acceptable service to the predominant 
user type or to a certain segment of the network. 
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Another weakness of X3. 102 is that it is not designed to 
be dynamic enough for real time measurement. Although the 
required state-of-art technology needed to provide a real- 
time performance index for user groups probably exists, it 
would be very expensive both in capital costs and in impact 
upon existing network resources. 

The parameters of X3.102, although useful, have too many 
dimensions for real-time use. Twenty-one parameters to eval- 
uate is beyond the comprehension of most users. This chapter 
will address a method of categorizing user types, perform- 
ance needs for a user type, and develop a usable index of 
performance specifically for the user type. 

B. PERFORMANCE REQUIREMENTS FOR VARIOUS USER TYPES 

Although a large number of ways exist to categorize user 
groups in an integrated network, groups will be categorized 
here by traffic type. Three user types will examined for 
illustrative purposes; voice users, interactive computing 
users, and large data file transfer users. 

Voice transmission, essentially "telephone calls", on a 
packet switched network are digital representations of the 
users' voices in packet form. Although once digitized and 
encoded, they resemble digital data transmissions, but 
cannot be treated generally like data [Ref. 26: p. 2.2.2]. 
Conversational voice signals give rise to traffic with 
moderately high throughput and low variable delay require- 
ments. Information integrity, on the other hand, is not as 
critical. Voice users typically perceive performance subjec- 
tively. Delay beyond about 400 milliseconds becomes objec- 
tionable under most circumstances and error rates in excess 
of about 10“ ® start to become objectionable. This can vary 
due to whether the error causes packet loss or just a 
dropped bit within the packet. Most links can usually 
provide this level of error performance. Experimental packet 
voice circuits in present operation normally utilize error 
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checking for packet overhead (addressing and sequencing) but 
neglect it in the actual data portion of the packet. 

Interactive computing service similarly requires low 
delay, relatively low throughput, but high data integrity 
(low error rate) in order to be effective. Large data file 
transfer users typically desire high throughput and data 
integrity, but will still be effective with longer delays 
than voice and interactive computing users. 

C. CHARACTERISTICS OF A USER ORIENTED, REAL-TIME 

PERFORMANCE INDEX 

A performance index, in order to be useful, must possess 
certain characteristics. Although not exhaustive, the 
following are a basis for the desired characteristics: 

1. The index should be understandable and available to the 
user on a real time basis. 

2. The index must give a reasonably good indication of 
what actual network performance is. 

3. It should indicate the degree to which user needs can 
be fulfilled. 

4. It should be derived from actual network conditions and 
existing network performance measures. 

5. It should exhibit reduced dimensionality. 

6. It should be responsive to changes in actual network 
performance. 

7. The index should be stable and not subject to wild 
oscillations. 

8. The index should not be swamped by a high value of some 
performance attribute masking marginal performance in 
another attribute. 

9. Some indication of performance stability would be 
desireable. 

The first three characteristics require that the index 
be oriented to the user and available to the user either on 
demand or displayed continuously. The actual display could 
be in the form of a number on a screen, a meter movement, or 
even a LED display on a telephone handset. The index must 
be related to the parameter levels which most directly 
affect performance as perceived by the end user. Those 
parameters are related specifically to data rate, end-to-end 
delay, and service quality. 
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The fourth characteristic indicates a desireabi li ty to 
not only utilize existing performance parameters of the 
network, such as X3.102, but also some of the parameters 
being monitored for network management and operation 
benefit. This ties actual network performance into a user 
available index. The fifth characteristic, reduced dimen- 
sionality, is vital if the index is to be used in a user 
session basis. Even X3.102, which is a "user-oriented" 
performance parameter set is not designed for real-time user 
evaluation, due in large part to its significant number of 
parameters. Some method of combining pertinent parameters 
must be done to provide a one or two dimension index is 
needed. If properly done, this will ease the real-time deci- 
sion making process. Although an exact mapping of such 
parameters into an index is beyond the scope of this thesis, 
a suitable combination technique will be developed. Any 
method of combining separate, dissimilar performance meas- 
ures into a single index involves making trade-offs as to 
the relative importance of each measure. This thesis will 
also address a method of specifying these relative weights. 

The sixth and seventh characteristics of responsiveness 
and stability, although working in direct opposition to each 
other, are still desireable properties of our performance 
index. A method that does not respond to actual changes in 
network performance is useless as its value may bear little 
resemblence to the true level of network performance. In 
addition, if the user is able to get a subjective "feel" of 
the network's performance ( e. g. noting a longer than usual 
delay or slow response) and if it is not reflected in 
reduced performance index level, the user will lose faith in 
the index as a useful tool and will disregard it. On the 
other hand, if the index is so responsive that it swings 
significantly due to performance degradations lasting such a 
short time period as to be otherwise unnoticed by the user. 
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the user will again lose faith in the index's value and will 
disregard it 

The eighth characteristic of resistence to swamping is 
important. For example, a voice user needs moderate 
throughput, short delay, and relatively low quality. If the 
network can provide the necessary throughput but the delay 
is excessive, the index should not change significantly if 
quality varies from "good" to "excellent". In this case, the 
overall performance which is poor due to excessive delay 
should not be masked by large values of quality. 

The last characteristic, the measure of stability, can 
be of benefit to the user particularly during long sessions. 
This stability measure would be a separately provided 
measure in addition the composite measure of quality, delay 
and rate. The stability is more accurately an indication of 
the rate of change in network performance for a particular 
user group (voice, file transfer, interactive processor). If 
the stability measure is provided in terms of direction (+ 
or - indicating improving or degrading performance) and 
magnitude ( the rate at which the performance is changing due 
to increased network loading and related problems) the user 
can make intelligent decisions as to whether the system will 
meet his needs over the length of his session. This 
stability measure could be disregarded in the case of most 
voice sessions if they are only expected to be of short 
duration (several minutes). This stability measure may also 
be of benefit to network management and operations forces in 
determining when to establish measures to reduce access or 
reconfigure the network in an effort to maintain a usable 
performance level to those users already in the network. 

D. THE MODEL FOR ESTIMATING A NETWORK PERFORMANCE INDEX 

Of all of the parameters that characterize network 
performance, there appears to be three measures that most 
directly affect the user-perceived performance. These are 
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the throughput or data rate available to the user, the delay 
in the information reaching the destination, and the quality 
of the service provided. These three measures are not inde- 
pendent. Actions taken to change one of the parameters will 
likely have a noticeable effect on the others. The 
constraints that this places on our model selection will be 
explained later. This section will take each of these three 
measures, describe it, discuss methods of expressing its 
value, and how the utility to the user varieswith the param- 
eter value. Then the measures will be combined into an index 
which fulfills the desired characteristics previously 
described. 

1. Throughput (Rate) 

Throughput has been defined as the effective rate at 
which data can move from source to destination. Although one 
can argue that "more is better", one can also ask "Is twice 
as much twice as good?". In general, a throughput below some 
minimum acceptable value provides the user with very little 
meaningful utility and above some higher value, no addi- 
tional benefits are gained. As an example, if a network can 
only provide a user with an effective throughput of 10 bps 
and his needs are 1200 bps, the network throughput will be 
of little value. If the network now provides an effective 
throughput of 800 bps, it will be of more benefit to the 
user, and even more benefit if the effective throughput is 
1300 bps. Is the user any happier if now the network can 
provide an effective throughput of 2400 bps? Probably not. 

A significant factor in determining the necessary 
data rate is the user type. Interactive processing users 
have generally low throughput requirements. Voice users 
integrated into a packet network have a significant data 
generation rate but due to the bursty nature of human speech 
( <40% duty cycle) only a moderate throughput is required. 
Users involved in large data file transfers require a 
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significantly higher throughput due to the high data rates 
that the user's terminals/computers are capable of and 
because the users do not wish their resources tied up 
waiting to slowly transfer data files when they could prob- 
ably be better used on another task. If a user must be 
present at the terminal (which is getting less and less 
likely as terminals get more sophisticated) the cost of that 
person's time plus the opportunity cost associated with what 
he could be doing must also be taken into account. 




Figure 4. 1 Utility Versus Throughput. 

The curves shown in Figure 4. 1 qualitatively shows 
the utility or benefit to the user as a function of 
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increasing the effective data rate available to the user. We 
expect that the utility would be low (zero) for throughput 
values less than the minimum acceptable value. The minimum 
acceptable value is lowest for interactive processing users, 
then voice, then finally for large data file transfer users. 
As data rate increases, more utility is derived until some 
level is reached where no more benefit is derived from 
increasing the data rate. The utility associated with this 
maximum level is assigned an arbitrary value (10). The 
actual values of minimum acceptable rate and the rate asso- 
ciated with maximum user utility ( indicated by the lines 
marked 'A' and 'B') will actually vary from user to user 
based on his own personal needs and equipment capabilities. 
Some determination of a nominal or average value would have 
be required for actual network implementation. Linear, 
concave upward, and concave downward curves are shown for 
illustrative purposes. In later utility versus parameter 
figures, only the linear relationship will be shown. The 
exact shape of the curve between 'A' and 'B' is unknown. It 
could actually be a combination of linear, concave upward, 
and concave downward segments as seen in Figure 4. 2 In order 
to meet our required characteristic of being derived from 
actual network conditions and performance measures, it is 
the author's opinion that the "user information bit transfer 
rate" of X3. 102 would be the best parameter to use as the 
rate measure on the horizontal axis. 

2. Delay 

Delay is the amount of time it takes for data, once 
inserted into the network, to arrive at the destination. 
This is the information that "block transfer time" of X3. 102 
provides. Other delays may be important to the user, partic- 
ularly if sequential communication sessions with different 
destinations is desired. An example would be a voice user 
wishing to place phone calls to several different people. 
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Figure 4.2 Possible Utility Profile. 

one right after another. The additional times of interest 
then include "access time" and "disengagement time". These 
are the times associated with connection to a destination 
and the time required to free up the allocated resources and 
user equipments once a session is complete allowing the next 
connection to be made. These times could be combined to form 
a composite user-to-user delay in the form: 

D = a*Tl + b*T2 + c*T3 . ( eqn 4.1) 

where 'D' is the user-to-user delay, T1 is the access time, 
T2 is the block transfer time, and T3 is the disengagement 
time. The constants, a, b, and c are weighting constants 
associated with the relative importance of Tl, T2 , and T3. 
These relative weights will probably vary for each user 
group. In the case of voice, the block transfer time takes 
on great importance so 'b' would have a large value compared 
to 'a' and 'c'. One can rationalize the relative importance 
of a, b, and c for the various cases but additional research 
would be needed to determine the exact values of these 
weighting factors 

Once the composite delay formulation is accom- 
plished, one can then qualitatively plot user utility versus 
delay for the various user groups as shown in Figure 4. 3 
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Figure 4. 3 Utility Versus Delay. 

In this case, maximum utility ( arbitrarily set to 
10), is derived until a minimally noticeable delay is 
reached at line 'A'. The derived utility then drops off 
until a utility value of zero is reached at the maximum 
acceptable delay at line 'B'. Above this value, the user 
finds the delay totally unacceptable. It is believed that 
the desired delay for voice and interactive processing would 
be relatively short compared to that of large data file 
transfer. The "window" of acceptable delay is also expected 
to be narrower in the case of voice and interactive 
processing than that expected for file transfer. Here again, 
the exact shape of the curve ( linear, concave upward or 
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downward, or a combination) is not known and would have to 
be determined. 

3. Quality 

The quality of service that a network provides is a 
function of the of the accuracy with which the system repro- 
duces the source information at the destination as well as 
the reliability by which the network operates. These parame- 
ters fall under the accuracy and reliability criteria 
expressed in X3.102, where accuracy deals mostly with data 
and address error probabilities and reliability deals with 
the ability of network resources to remain on line and the 
availability of network nodes and links to maintain connec- 
tivity to those resources. In a homogeneous, integrated 
network, we expect that the reliability aspect of quality is 
equally important to all user groups. In cases where this is 
not true, reliability would have to be weighted accordingly. 

Although a functional mapping of reliability and 
accuracy into "quality" will not be attempted here, a quali- 
tative relationship will shown. Figure 4. 4 shows this 
expected relationship between user-derived utility versus 
quality of service. 

Because of the interpretive ability of the human 
mind, accuracy (quality) is not as important to voice users 
than it is to interactive and data file transfer users. This 
is seen in Figure 4. 4 in the case of voice having a lower 
minimum acceptable and lower maximum necessary quality in 
order to derive a maximum utility value of 10. Again the 
exact shape of the curve would have to be determined. 
Although some differences may exist between the quality 
needs of some interactive processors and large data file 
transfer users, they both require generally high accuracy 
and thus were treated the same. 
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Figure 4. 4 Utility Versus Quality. 

4. A Composite Performance Index 

In specifying user-perceived performance in terms of 
the delay, rate, and quality, the dimensionality of perform- 
ance measures has been significantly reduced. In order to 
meet another of our desired characteristics, we will need to 
further reduce these three dimensions into a single 
composite performance index. 

Several methods of combining performance measures 
into a single index exist. One of these methods has already 
been demonstrated in our discussion of delay where a summa- 
tion was used. The composite function for performance (P) 
would then become: 

P = A * Delay + B * Rate + C * Quality ( eqn 4.2) 

where Delay, Rate, and Quality are the utility values taken 
from the appropriate curves and A, B, and C are their 
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respective weighting factors expressing the relative impor- 
tance of the three measures. This is a simple method but 
does not meet the required characteristic of the index not 
being swamped by a high value of a single parameter. As an 
example, if A, B, and C are assumed to be equal to 1, if 
delay and rate have unacceptable values (0) and quality has 
a maximum value of 10, performance (P) is equal to 10. This 
would be the same performance index value in the case where 
all three measures were 3 1/3. The additive model is also 
disregarded here because delay, rate, and quality are depen- 
dent on each other. Additive models assume parameter inde- 
pendence [Ref. 27: p. 320]. The actual perceived 
performance would obviously be greater in this latter case. 

Another method of reducing the dimensionality is by 
just using the worst of the three measures as the value of 
the composite index. As an example, if quality and delay 
have values of 6 and 7 respectively and rate has a value of 
3, then the index has a value of 3. If quality and delay 
both go up to 10, the index still remains at 3. Even though 
user perceived performance has gone up, the index has not 
which does not meet our desired characteristic of respon- 
siveness. 

Yet another method of combining the parameters 
exists, the product of the terms: 

P = D * R * Q ( eqn 4. 3 ) 

If any of the parameters is less than than the minimum 
acceptable value required, total performance is 0. This 
equates to the user receiving unsatisfactory service from 
the network. As long as all the values are not zero, as any 
of the values goes up, the index goes up and no swamping 
exists. One problem that arises is that this index is some- 
what over-responsive ( i. e. if all parameters double, the 
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performance index value goes up by a factor of eight). A 
minor modification of this formula solves this: 

P=( D*R*Q)i/ 3 (eqn 4.4) 

Taking the cube root of the product restores a degree of 
"linearity" to the index. Taking the 'N'th root of a 
product, where 'N' is the number of variables in the 
product, restores a first order characteristic as all the 
variables are changed. In this case, all the parameters 
making up the index all have equal weight (delay, rate, and 
quality all have a maximum utility value of 10). Relative 
weighting factors can be introduced simply by adjusting the 
maximum value of utility in the curves relating utility 
value versus performance parameter value. In implementing 
this weighting, one should try to ensure that the product of 
the maximum utility values remain the same for each of the 
user groups. 

This formulation appears to meet all of the desired 
characteristics dealing with parameter and index values. A 
multiplicative model form is most appropriate when the 
parameters are not independent, that is, when one assumes 
that the variables act conjunctively [Ref. 27: p. 321] . 
Those characteristics that are more strongly dependent on 
the measurement technique and parameter value computation 
are beyond the intended scope of this thesis but would 
require evaluation before implementing such a performance 
index. 

5. Stability 

Depending on the nature of the network, its users, 
and the methods of network control, network performance can 
have great variability in the terms previously discussed. 
Periods of poor performance can be tolerated as long as they 
only last for a short period of time and do not occur very 
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frequently. If performance degrades during a session lasting 
only a few minutes, and remains degraded, user satisfaction 
will also deteriorate. If the network performance cannot be 
maintained reasonably stable during a user session (unlikely 
when some sessions may last an appreciable time), then some 
indication of the network performance stability would be 
useful. 

This determination of stability would be difficult 
to perform. It would involve short-term, real-time 
predicting of network usage trends. An instaneous deriva- 
tive of the performance of the user group performance index 
would probably fluctuate too rapidly to be of use, so a 
damped or time averaged measure of the rate of change of 
performance over time becomes a better alternative. 

Short term sessions such as typical phone calls 
lasting only several minutes may not benefit from such a 
stability measure but longer sessions, particularly interac- 
tive processing and data file transfers requiring periodic 
operator action could particularly benefit from such a 
stability measure. As mentioned before, the objective would 
be to help the user plan network usage to fit his needs and 
time constraints so he can obtain the maximum benefit 
fromthe resources he utilizes in his network operations. 



63 



V. THE FUTURE 



Nodal performance is an abstraction that most users and 
providers can loosely define but when forced to quantify it 
in universal terms, they often fall short and have strong 
disagreements. This is a key reason why standards are so 
long in development. The transitioning from purely network 
provider oriented measures to a situation where both 
provider oriented and user oriented measures has not been 
easy and is far from complete. The need for these measures 
to be separate but connected arises from a fundamental 
difference in the ways users and providers view telecommuni- 
cations networks. To the typical user, the network is a 
"black box" that moves information from one place to 
another. The user is not concerned how the movement is 
accomplished, whether it is by circuit switched telephone 
lines or by satellite links or by terrestrial packet 
switched networks. He is also not concerned with aspects of 
the network's internal design as long as his needs in terms 
terms of quality and speed are met. 

Users need performance measures for two primary reasons: 
[Ref. 28: p. 30.6.3] (1) to assess the effects of network 
imperfections on user operations; (2) to perform cost/ 
benefit tradeoffs among networks, service alternatives and 
time usage. From the users' point of view then, performance 
is best expressed by parameters which focus on user- 
perceivable effects rather than their causes within the 
networkand do not depend on, in their detailed definitions, 
assumptions about the network's internal design or proto- 
cols. Such measures may be characterized as network 
independent. 

To a network service provider, the network is a collec- 
tion of connected subsystems, each playing a specific role 
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in realizing an end-to-end service. Unlike the user, the 
provider is vitally concerned with the technology and design 
of the individual subsystems, their specific performance 
capabilities, and the interaction between them. Because the 
provider is responsible to all users, he must concern 
himself with resource utilization, network operations, and 
facility maintenance issues that aren't of direct concern to 
any specific user. His interest in performance centers on 
relating end-to-end performance objectives to subsystems. 
From the provider's point of view, the performance parame- 
ters should focus attention on specific network parts and 
protocols being used and should be useful in identifying 
causes of user-oriented performance effects. In this regard, 
the provider-oriented parameters should be network specific. 

To be useful, the user-oriented and provider-oriented 
measures should be relatable. American National Standard 
X3. 102 and its companion Federal Standard 1043 meet these 
needs except they do not provide the timely information 
needed for cost/benefit tradeoffs of network service time 
usage. This is where a real-time network performance index 
would be useful. 

In determining real-time user-oriented performance meas- 
ures, enormous amounts of data must be gathered, sorted, 
evaluated, and outputed in real-time. Equipment exists to 
measure the required parameters on a single connection but 
to test all possible connections in a large network would 
require a tremendous effort. Even to sample a statistically 
significant fraction of all connections presently would be 
expensive to do as frequently as we desire. 

One solution to obtaining the timely information on 
network performance at reasonable cost is not to make 
performance measurements on end-to-end connections but 
rather on the components that make up the connections such 
as loops, switches, and transmission facilities [Ref. 25; 
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p. 2C. 5. 3] . These are the provider-oriented performance 
measures discussed previously. The number of possible compo- 
nents will be much smaller than the number of ways that they 
can be put together. Once the information is available on 
the performance of each component making a connection, the 
component parameters can be combined and translated into 
parameters used to characterize the end-to-end performance. 
These are then termed user oriented performance measures. 

The resources involved in continously monitoring all of 
the components in a network is still a large task and is not 
yet done on a continous real-time basis for a reasonable 
cost. A possible solution lies in a technique of network 
performance monitoring that has been recently developed 
known as "Perturbation Analysis" [Ref. 29]. 

Perturbation analysis is an emerging technique for 
performance evaluation and on-line network control based on 
actual network data. Given some performance measure, P, and 
associated parameters ( e. g. quality, delay, and rate), it 
is possible to estimate the rate of change of the measure 
from observations even though the exact functional relation- 
ships may not be known. The application of perturbation 
analysis involves a "black box" connected to the system 
(network). This is an on-line processor whose function is to 
observe the actual network state, evaluate the perturbed 
state resulting from small changes in parameter values and 
ultimately provide the perturbed performance measure values. 

Although the exact formulation of algorithms is far 
beyond the scope of this thesis, perturbation analysis 
consists of three steps. The first is perturbation genera- 
tion which involves the mapping of a parameter perturbation 
into a perturbation in a service completion event. Then 
perturbation propagation deals with how the perturbation 
moves through and affects the entire network, and finally 
the third step is the calculation of the effect on the 
performance measure. 
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One assumption that present perturbation analysis is 
constrained by is that perturbations must be sufficiently 
small so that the order of events remains unchanged at each 
node or process. Violation of this assumption can result in 
considerable degradation of perturbation analysis perform- 
ance. This severely limits the applicability of it to real 
networks. Research is currently being done dealing with 
improving perturbation analysis accuracy and gaining a 
better understanding of its limitations [Ref. 29: p. 13. 5. 4] . 

A. CONCLUSIONS 

Modern packet switched networks have undergone signifi- 
cant changes since their birth in the 1960 's. They have 
evolved into almost "universal translators" converting 
information from one source into a digestible form for use 
at a significantly different destination, supplying speed, 
coding, and protocol conversion as necessary [Ref. 2: 
p. 1311] . Nearly all of the packet switched networks have 
dealt strictly with data but the time when voice and other 
users will become integrated is nearing. Voice, in an inte- 
grated network will present problems because it must be 
handled differently to be of use to the user. 

Integration of voice does provide some interesting 
possibilities. It is a highly variable rate information 
source possibly permitting great network flexibility under 
dynamic traffic conditions. This is due significantly to the 
natural statistical multiplexing characteristics of packet 
switched networks. 

As future networks evolve, it is clear that networks 
will be integrated. Even though significant cost/benefit 
advantages have been projected for totally packet switched 
networks due to improved efficiency in resource sharing, and 
system flexibility and modularity [Ref. 30] the world where 
all networks are packet switched networks is very unlikely. 
Due to tremendous capital investments in existing resources 
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and that needed for complete packet implementation, networks 
will likely be hybrid networks. These hybrid networks, where 
aspects of circuit and packet switching are used in some 
parts or all of the network, point out the need for user- 
oriented network independent performance measures such as 
ANS X3. 102. This type of measures have shown great useful- 
ness for service selection of one network over another, 
specifying user requirements in performance terms, and in 
characterizing the service performance of a network pres- 
ently being used. Standardized performance measures have 
demonstrated the potential to save several hundred million 
dollars annually. 

As networks such as the public telephone network 
evolved, user habits have caused degrees of congestion where 
resources are stretched so thin, at times, that they are 
useless to those wishing to access the network. Some of the 
problems have been solved by resource expansion and a lot 
has been solved by management actions to spread the demand 
more evenly over time. Actions such as reducing usage 
charges for off-peak hours have worked well but a large 
amount of demand variability still exists during peak priced 
hours. A similar situation can be expected to occur in 
packet switched networks as they become more widely used. If 
the variability in congestion ( and the related performance 
degradation) could be quantified and made available to the 
user, a means of user self-control exists. This performance 
index could prove valuable to users in trying to gain more 
benefit from their own resources and available time. 

This real-time index must have certain inherent charac- 
teristics as outlined in the previous chapter of this 
thesis. Some means of combining the most relevant perform- 
ance parameters that the user is concerned with (rate, 
delay, and quality) is needed for ease of use. 
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In integrated networks, one can treat all user data as 
the same but it has been shown that user needs are not 
uniform. Some data types require significantly different 
levels of performance attributes in order to have adequate 
service. A real-time performance index must acknowledge that 
fact and model itself more closely to user needs. 

In addition to the users benefitting from such a real- 
time performance index, the network manager/provider can 
benefit as well. In his actions of controlling and tuning 
the network, the manager would be able to see how his 
actions affect user-perceived performance. Future networks 
will be flexible in packet sizing, flow and congestion 
control, and routing algorithms. Actions taken to benefit 
one parameter may have detrimental affects on another and 
unless the manager can quantitatively see how his actions 
are affecting the users, he can't be sure his decisions are 
the best possible. The manager may have the capability to 
fine-tune the entire network for a predominant or highest 
priority user type. He may be able to fine-tune a specific 
portion of the network in the same fashion. The capabilities 
of the future are unknown today. 

In providing a new network or in developing new service 
capabilities, the network designer must always keep the user 
in mind. New systems must strive to to supply performance 
better than or equal to that which may be presently be 
provided. It is also here where user oriented performance 
parameters may be of benefit. Modelling network designs to 
meet user needs will help ensure network systems meet those 
needs without needless expense for performance improvements 
which are not perceivable to the user. 

B. AREAS FOR FURTHER RESEARCH 

As in many instances research, the research often 
results in more questions than answers. These questions 
result in more areas of research to be explored ( or at least 
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considered) prior to implementation of an idea. It is 
obvious to this author that, even though there are benefits 
to be gained, the implementation of a real-time user- 
oriented performance measure is a long way off. 

One of the foundations of this idea is that the peak 
demand created by the users is greater than what the network 
resources can supply, resulting in congestion. If network 
capabilities grow faster than demand such as in the case of 
the DDN where plans exist to expand the backbone capacity 
from 56 kbps to 1. 544 Mbps, congestion may be alleviated 
until demand catches up [Ref. 2: p. 1311] . Resource growth 
is often in bursts while demand usually increases 
inexorably. 

It has been shown that networks usually require both 
management oriented and user oriented performance measures. 
The parameter mapping of the associated parameters into the 
units related to quality, delay, and data rate needs to be 
explored. Questions exist in the area of determining, to 
what degree network usage will be effected by knowing how 
well the network is performing. This degree of man-machine 
can be speculated about but a realistic determination of how 
this knowledge affects user behavior modification and demand 
smoothing, must be explored. Since each user group is 
expected to have a different utility versus parameter value 
profile, one can expect that each user, in his subjective 
determination of performance, has a different profile. How 
can these be combined to get a usable utility profile for a 
group? 

Mention was made of using this index as a possible modi- 
fier for usage charging. This charging could be based on 
resource usage, contribution to network congestion, or by 
user type. What, if any, would be the best way to implement 
this concept? Since such a real-time index would involve a 
monetary cost for implementation, at what cost/benefit level 
does its introduction show usefulness. 
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The last point concerning the index deals with the delay 
parameter associated with voice. Present networks use satel- 
lite links on some long haul calls. This delay can be 
annoying but people are accepting it as "the way that it 
is". If delay takes on less importance to voice users, than 
can we treat voice like any other data or must we invent 
another parameter such as "delay variability" to charac- 
terize users' needs. 

Additional areas needing further research also lie with 
future networking problems related to integrated networks. 
As the speeds of these networks increase due to better 
transmission media and improved hardware/software, more 
packets will exist en-route between sources and destina- 
tions. A determination of whether existing methods of flow 
control, routing, or acknowledgement techniques will be 
adequate or if new ones will be needed must be made. 

If, as it is suggested, that voice integrated on a 
network must treated differently due to the subjective eval- 
uation that takes place, how will it be handled? Will it be 
prioritized with other types of data sent during silent 
periods or will it separated and handled in a subnetwork? 
Data compression techniques exist which provide the same 
information as the original data but incorporating fewer 
bits. How can this be applied to voice data communications? 
The question of what to do with lost voice packets also 
arises. Voice packets not only need to be sequenced but also 
need some sort of time stamping so that playback at the 
destination takes on a natural sound. Some network experi- 
ments have substituted silence for the lost packet, others 
have used a tone indicating lost speech. Both of these have 
unnatural sounding qualities. A better substitute used in 
other experiments have used repetition of the last correctly 
received packet to replace lost packets. All of these may 
have serious problems in secure voice applications where 
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characteristics of previously received data may affect the 
decoding of present data. Most of these experiments were 
conducted on the ARPANET [Ref. 31: p. 27. 3. 3] . These experi- 
ments, using 100 to 200 millisecond long packets have demon- 
strated good quality. Selecting packet length involves a 
tradeoff. Small packet size causes the percentage of total 
bits devoted to overhead to increase, degrading efficiency. 
Long packet size tends to raise the minimum delay due to the 
time it takes to packetize the data at origination. 
Experiments with voice , with its extended bursty nature 
requiring real-time delivery, have shown that these same 
requirements may also fit military applications involving 
data retrieval of datafrom remote sensors. 

Lastly, in network design and implementation, perform- 
ance must be equal to or better than that provided by 
present systems. Work needs to be done to chracterize the 
performance of the present systems in terms of the user 
oriented performance measures for this goal to be met. 
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